Dynamic Decision Making in Stochastic Partially Observable Medical Domains: Ischemic Heart Disease Example
نویسنده
چکیده
The focus of this paper is the framework of partially observable Markov decision processes (POMDPs) and its role in modeling and solving complex dynamic decision problems in stochastic and partially observable medical domains. The paper summarizes some of the basic features of the POMDP framework and explores its potential in solving the problem of the management of the patient with chronic ischemic heart disease.
منابع مشابه
Dynamic Decision Making in Stochastic
The focus of this paper is the framework of partially observable Markov decision processes (POMDPs) and its role in modeling and solving complex dynamic decision problems in stochastic and partially observable medical domains. The paper summarizes some of the basic features of the POMDP framework and explores its potential in solving the problem of the management of the patient with chronic isc...
متن کاملScreening and Treatment of Chronic Diseases
In recent years, Markov decision processes (MDPs) and partially observable Markov decision processes (POMDPs) have found important applications to medical decision making in the context of prevention, screening, and treatment of diseases. In this chapter, we provide a review of state-of-the-art models and methods that have been applied to chronic diseases. We provide a tutorial about how to for...
متن کاملBayesian Nonparametric Approaches for Reinforcement Learning in Partially Observable Domains
Making intelligent decisions from incomplete information is critical in many applications: for example, medical decisions must often be made based on a few vital signs, without full knowledge of a patient’s condition, and speech-based interfaces must infer a user’s needs from noisy microphone inputs. What makes these tasks hard is that we do not even have a natural representation with which to ...
متن کاملStochasticModelPredictiveControl: Output-Feedback,Duality andGuaranteedPerformance
A new formulation of Stochastic Model Predictive Output Feedback Control is presented and analyzed as a translation of Stochastic Optimal Output Feedback Control into a receding horizon setting. This requires lifting the design into a framework involving propagation of the conditional state density, the information state, via the Bayesian Filter and solution of the Stochastic Dynamic Programmin...
متن کاملPlanning in Stochastic Domains: Problem Characteristics and Approximation
This paper is about planning in stochastic domains by means of partially observable Markov decision processes (POMDPs). POMDPs are di cult to solve. This paper considers problems where one, although does not know the true state of the world, has a pretty good idea about it and uses such problem characteristics to transform POMDPs into approximately equivalent ones that are much easier to solve....
متن کامل